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Abstract: A continuous algorithm for max-bisection is proposed. We first convert the max-bisection 


problem to a nonlinear program, then the resulted problem is solved by using the augmented 
Lagrange penalty function method. 
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1 Introduction 


Let G(V; E) be an undirected weighted graph, where V = {1,--- ,n} is the set of nodes, Æ 
is the set of edges. Let W = (wi;) be its weighted adjacency matrix with w,; > 0 for (i,j) € E 
and w;; = 0 for (i,j) g E. Max-bisection consists in finding a partition of the set V into two 
sets S, T = V \ S, such that |S| = |T| = n/2 and the total weight of edges with endpoints in 
different subsets is maximized, i.e. 


w(S) = max 5 Wij, 
iES,jET 
when n = |V| is even. The problem can be formulated by assigning each node a binary variable 
zti E€ {-1, 1} 


1 
MB: max { F(x) a So wyll — zizj) = xTLx: ex =0, x€ {-1, iy"), 
ij 
where 
t 
4 


Diag(a) means a diagonal matrix whose diagonal entries are vector a. The constraint e™x =0 


x =(21,2,---,tn)’, S={ilz;=1}, e=(1,1,---,1)€R", L= -(Diag(We)- W), 


ensures that 
n 


|S| = |T| = 7 
Frieze & Jerrum!!! extended Goemans-Williamson’s approach?! to max-bisection and obtianed 
an 0.65l-approximation algorithm. Ye in [4] improved this result to 0.699. Recently, Xu et 
al.3] proposed a feasible direction algorithm without linear search in which max-bisection was 


relaxed into a quadratic programming problem with nonlinear constraints 


XMB: max{x’Lx: @p(1—2;,14+2;) <0, j=1,--- , 0; e™x =0; || x ll2= 1}, 
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where ®-(a,b) = Va? + b? — (a +b), a, b € R is the FB function. 


2 Equivalent nonlinear program 


A function ® : R? > R is called an NCP-function if (a,b) = 0 & ab = 0, a > 0, b > 0. By 
this definition, we define (a, b) = max(0, ab)? + max(0, —a)? +max(0, —b)3. Clearly, ®(a, b) is a 
NCP function. Let a = 1 — zi, b= 1+ zi, i=1,--- n, then (1 —2;,1+2;) =0 & 2,{-1,1}. 
Moreover, it is easy to show ©(1—2;, 1+2;) has up to the second order derivation with respective 
to z;, i =1,---,n. Hence, MB can be rewritten as 


MB1: max{f(x)=x7Lx: e?x =0; (1 —2;,1+2;) =0, i=1, n}. 


Let Amax(Z) denote the maximum eigenvalue of matrix L, and p = 47Amax(L). Consider the 
following problem 


MB2: max{F(x) = x? Lx—px7ee!x = x7(L—pee™)x: ®(1—2;, 1+2;) =0,i=1,--- ,n}. 


Then we have the following results. 

Lemma 2.1 Let x** be an optimization solution of problem MB2. Then x** is also an 
optimization solution of problem MB1, also MB2 and MB1 have the same optimization value 
at x**. 

Lemma 2.1 shows that, instead of solving problem MB1 directly, we can also obtain its 
optimization solution by solving problem MB2. Let C = —(L — pee’). Then MB2 can be 
written as 


MB3: min{h(x) = xTCx = xT (pee? — L)x: (1 —2;,1+2,;)=0, 1=1,--- ,n}. 
The augmented Lagrange penalty function method (ALPFM) of problem MB3 has the form 
P(x; A,0) = h(x) = W(x) + ZOO, 
where 
W(x) = (b(e1),-+ (en)? = (OL — 21,1 + 21),---,6(1—ay,1 + £n))T, 


A = (àr, 5 An)” is the Lagrange multiplier vector, and ø is a penalty factor. The function 
P(x; A,o) has up to second order derivative and the gradient of the function P(x; À, ø) with 
respective to x is easily evaluated by 


VxP(x; A, 0) = 2Cx — VU(x)(\ — o F(x), 
where 


V¥(x) = Diag( ZED, ee HE), 


NO. 5 Li Yu, Ling Aifan: A Continuous Algorithm for Max-bisection 783 


3 Solving problem MB3 


Let x* and A* be an optimal solution of problem MB2 and the associated Lagrangian 
multiplier vector, respectively. The KKT condition at (x*, \*) of problem MB2 can be presented 
as 


VF(x*") — VU(x")\* = 0. (1) 


Let {A*}%9 be a given sequence. For each given \*, we can minimize P(x; AF, ø) for large 
enough o. Assume that x**+! is a minimizer of P(x;A*,o), then the sequence {\*}2.,, for 
large enough ø, is modified by 


AFHI = DF — Go U(x*t1), k=0,1,--- 


Hence, the minimizer x* of MB2 can be obtained by minimizing the function sequence P(x; A£, a). 
Summarize the statement above, we can described the algorithm for MB3 as follows. 
Algorithm CMB: 
1) Choose randomly an initial point x° € (—a,a)", a@>1, given oo, °, O<e<1 and 
0<p<1,setk=0; 
2) Start from x*, minimize P(x; \*,o,) to obtain a solution x*+1. If || U(x*+?) ||< €, 
set x* = x*+1, goto 5); 
3) If |] B(xkt*) |> p |] V(x*) |], set oy = 100% and x, = Xk+, goto 2); 
4) If |] U(x*t1) |< p || U(x*) |], set AFt! = AF — opt (x+), ok+1 = on, andk=k+1, 
goto 2); 
5) Construct a bisection. 
(a) If {S| = %, then output S is an optimization bisection partition and stop; 
(b) If |S{ > §, then for each node i € S, compute 


(i) = So wi — X wis, 
jes jET 
and rearrange the set S = {%1,42,--- ,ijsj}, where 6(#1) < (i2) <--- < 4(45)). 
Let S = {i1, i2,- sig}; 
(c) If [S| < 3, then set x* = —x*, goto step 5)(b). 
The solution sequence {x*}2.) obtained by the algorithm CMB generates a sequence{U(x*)}?°.4 
that converges to zero at a rate less than p, the condition || U(x*t) ||< € can be satisfied in a 
finite number of iterations (see [3}). 

Theorem 3.1 If {A*}$, isa bounded sequence and x* is a global minimizer of P(x; \*~, 
ox), then any accumulation point x* of the infinite sequence {x+} Zo generated by the algorithm 
CMB with termination criterion || U(x*) ||= 0 is an optimal solution of problem MB3. 

Proof By algortihm CMB, the infinite sequence {x*}, generated by the algorithm CMB 
satisfies 

SOE < pV), O<p<l 


That is 
lim ||Y(x*)|| = 0. 
k- 00 
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Hence, any accumulation point of the infinite sequence {x*}2° o must be a feasible solution of 


MB3. 

Let {x*i} be a convergent subsequence of {x*}?o and x* its limitation point. Then x* is 
a feasible solution of MB3. Let x** be a global optimal solution of MB3. Since x* is a global 
minimizer of function P(x; \**—1,¢,,) and x** is only a feasible solution of P(x; AFIL Ok), 


we have, for sufficient large kj, 
Ck; 
Px; AE or) = h(x) = (ATIT) + HE YE Wort IP 

< PAHI, op) = h(x"). (2) 

Since {A*}2°, is a bounded sequence, for sufficient k, it follows from (2) that 
h(x") + o(1) < A(x**). (3) 
Let k; — 00 in the left hand side of (3), it follows that 
h(x*) = lim A(x*i) < h(x**). 
k-00 

On the other hand, by the feasibility of x*, h(x*) > h(x**). Therefore h(x*) = h(x**) which 
means x* is an optimal solution of MB3. 
4 Numerical experiments 


For minimizing P(x; \*—1, ox) with fixed \*~1, ap, we use the function fminunc in Matlab. 

The test problems are some randomly generated graphs. Let p € (0,1) be fixed. For each 
pair (i,j), i Æ j, c € (0,1) is random number. If c < p, then there is an edge between nodes 7 
and j, and set w;j is a random integer number in [1,10]. Otherwise, set w;; = 0. We compare 
our algorithm with the 0.699-approximation algorithm, see Table 1. From the numerical results, 
one is not hard to see that the proposed continuous algorithm can generate a better solution 
than the 0.699-approximation algorithm for most of these problems. 


Table 1: Comparisons of 0.699-appro. algorithm and CMB 


ie] 
Gel 
le] 
J 
igu) 


0.699 CMB 

n p Fy ty Fé tc o 

14 0.60 17 031 | 19 068 10 
16 0.30 9 0.89 | 10 1.02 10 
20 0.60 25 131 | 31 206 10 
24 1.25 27 212 10 
71 195 | 75 256 104 
36 0.60 109 215 | 114 29% 10 
71 235 | 75 312 104 
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